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NATURAL LANGUAGE SEARCH METHOD AND APPARATUS 



The present invention generally relates to a method 
and apparatus for performing a search for information 
containing natural language using a natural language 
query. The present invention particularly relates to such 
a method and apparatus for providing context information 
for the best matches to the natural language query. 

Most information retrieval systems are quite good 
at finding information but poor in presenting the results 
to users. Typically the results are presented as a 
simple list of documents or document headers, sometimes 
with a relevance score. «■ A few web search engines attempt 
to improve on this by, for example, grouping pages from 
the same site together. It is difficult for users to 
make effective use of results lists, because the results 
list does not show how documents are related to one 
another and to the original query. 

Information retrieval systems can retrieve 
information using linguistic queries in several ways. 
The simplest and most common is the use of key words. 
Key words can be combined using Boolean logic or 
statistical techniques to form a query. It is also known 
from an article by S Flank entitled "A Layered Approach 
to NLP-Based Information Retrieval" (Proceedings of the 
36 Annual Meeting of the Association of Computational 
Linguistics, page 397, 1998) that a natural language 



input can be translated to a search engine specific 
Boolean logic query. Such a technique, however does not 
benefit from the syntactic information which is available 
in a natural language query. Such information can only 
be utilised by exploiting the structure of the query and 
the information by some form of parsing. 

The retrieval of information using syntactic 
information from natural language queries has been 
achieved in many prior art systems. A system described 
in J Fagans PhD Thesis entitled "Experiments in Automatic 
Phrase Indexing for Document Retrieval : A Comparison of 
Syntactic and Non-Syntactic Methods" (PhD Thesis Cornell 
University, Technical Report TR 87-868) uses augmented 
phrase structure rules to selectively extract phrases 
from parse trees generated by an automatic syntactic 
analyser. 

Natural language processing based information 
retrieval is also described in the paper by Flank 
referenced above. The technique described in this paper 
uses noun phrase syntax analysis. 

Another method of retrieving information is 
disclosed in an article by C Schwartz entitled "Automatic 
Syntactic Analysis of Free Text" (General American 
Society For Information Science, September 1990, pages 
408 to 417). In the technique disclosed by Schwartz, noun 
phrases are identified in the natural language passages 
in the query and in the information and they are selected 



for parsing. The parsed noun phrases are normalised so 
that the meaning representation structure is fitted to 
standard or common dependency structures . Noun phrase 
matching then takes place by a straightforward comparison 
of the normalised meaning representation structures in 
order to identify identical paths and nodes. 

Whilst the use of syntactic information from natural 
language queries in the retrieval of information can 
provide a more accurate searching technique, it does 
nothing to overcome the problem of how to present the 
results of the search. The results of the search are 
merely the best match or matches to the query with no 
information on how the documents are related to one 
another or to the original query. 

It is an object of the present invention to address 
this problem by using syntactic information to give the 
results of the search in context. 

In accordance with an aspect of the present 
invention there is provided a search engine for searching 
for data in the form of units of a natural language. An 
input query is matched to a plurality of available sets 
of information to identify the best matches and to 
identify which words in the query and in the sets of 
information match. For a number of the best matches the 
unmatched units in the query and/or the sets of 
information are used to form context data. The context 
data comprises one or more unmatched units of the query 



and/or the sets of information each of which has a 
predefined syntactic relationship to one of the matched 
units . The data output thus comprises the matched units 
and the unmatched units which have a linguistic 
relationship to the matched units . This additional 
context information enables the user of the search engine 
to not merely identify what is matched but also the 
context in which it matched. This provides far richer 
information enabling a user to understand the results of 
the search far more easily. 

In the context of the present invention natural 
language data comprises a series of units of a natural 
language which have linguistic relationships 
therebetween . 

The matching technique can comprise a simple keyword 
matching technique. This has the benefit of simplicity 
but does not benefit from the syntactic information 
available to improve the matching process. If keyword 
searching is used, the syntactic information used for 
forming the context data can be determined by a parsing 
operation either before or after the matching process. 

In order to make use of the syntactic information 
available in the input query and in the sets of 
information, preferably, the query and the sets of 
information are parsed and the matching takes into 
account the syntactic structure of the query and the sets 
of information in order to determine the match. 



The level of syntactic information used in the 
matching can be simple related pairs of words such as 
used in the work by Flank and Fagan as referenced 
hereinabove, or even a full set of semantic relationships 
between the words as described in the applicants co- 
pending application number: 9821969.4 filed on 8 October 
1998. 

In order to obtain the syntactic information , the 
parser used can be of any form. For example, the 
dependency parsers disclosed in GB-A-22699 23 r 
EP-A-0737928, a paper by T Jarvinen and P Tapanainen 
entitled H A Dependency Parser for English" (Technical 
Report No. TR-1, Department of General Linguistics, 
University of Helsinki, March 1997), and a paper by 
P Tapanainen and T Jarvinen entitled "A Non-Pro jective 
Dependency Parser" (Proceedings of the 5th Conference on 
Applied Natural Language Processing, Washington DC, April 
1997, Association for Computational Linguistics). The 
contents of all of these documents is hereby incorporated 
by reference. A dependency parser parses the natural 
language to generate meaning data which comprises meaning 
representations for the words and links between them. 
The links indicate which meaning representation modifies 
the meaning of other meaning representations and the 
links and type of links are determined with regard to the 
grammar of the natural language. 
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An embodiment of the present invention uses the 
output of a finite state parser implementing a dependency 
parser technique as described in co-pending application 
entitled: "Apparatus and Method for Generating Processor 
5 Usuable Data from Natural Language Input Data" filed on 
1 March 1999 by the present applicants, the content of 
which is hereby incorporated by reference. 

The searching technique is applicable to the 
retrieval of information of many different types. For 

10 example , the natural language query can be used to 
retrieve document data. In this case, either the natural 
language query can be compared directly with the contents 
of the document, or it can be compared with an abstract 
of the document in order to perform the matching 

15 operation. The searching technique is also applicable to 
retrieval of non-text data. Such data requires a natural 
language caption in the form of meta data. For example, 
in order to retrieve images from an image database, where 
images are given captions which describe the content of 

20 the images, a natural language query can be used in order 
to search the database to obtain a best match or matches 
to data in the database. 

The context data of the present invention comprises 
one or more unmatched units each of which has a 

25 predefined linguistic relationship to one of the matched 
units. In one embodiment this relationship comprises the 
modification relationship between the units. This 



information is obtained from a dependency parser. The 
generation of the context data in this embodiment is 
achieved in accordance with one or more rules which 
define contextually important modification relationships 
between matched and unmatched units . Thus the rules 
define the sort of context information which is to be 
output . 

More generally, in an embodiment the context data 
of the present invention is generated using one or more 
rules which contain syntactic and semantic constraints 
for the formation of the context data. 

In an embodiment of the present invention , the 
generated context data is not just output, but is used 
to structure the results of the search. The search 
result is thus the sets of information, which comprise 
the best matches to the input query, ordered in 
accordance with the context data. This ordering can take 
the form of a hierarchical arrangement of indexes wherein 
the indexes are layered in accordance with the syntactic 
relationships. The indexes comprise the matched and 
unmatched words of the context data. This embodiment 
enables a user to more easily grasp the significance and 
relationships between the matches obtained from the 
search . 

The present invention also provides an enhanced data 
retrieval system since the desired data obtained as best 
matches to the input query is output together with this 
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associated context information to enable a user to 
identify why the search has found that particular piece 
of data* 

The present invention can be implemented by software 
5 operating on a multi-purpose computer. The present 
invention is thus embodied by a computer program provided 
on a storage media such as a floppy disk, optical disk, 
magnetic tape, or programmable memory device. Further, 
since the computer program can be transmitted over a 
10 network such as the internet, the present invention can 
be embodied as a signal carrying the computer code. 

Embodiments of the present invention will now be 
described with reference to the accompanying drawings, 
15 in which: 

Figure 1 is a functional diagram of an embodiment 
of the present invention; 

Figure 2 is a schematic diagram of an embodiment of 
the present invention; 
20 Figure 3 is a flow diagram illustrating the 

operation of an embodiment of the present invention; 

Figure 4 illustrates the syntactic information used 
in the generation of the context data; 

Figure 5 is a flow diagram illustrating the use of 
25 the context data for the ordering of the results of a 
search in accordance with an embodiment of the present 
invention; and 



Figure 6 is a functional diagram of another 
embodiment of the present invention, 

A first embodiment of the present invention will now 
be described with reference to Figures 1 to 5 . 

Figure 1 is a diagram illustrating the functional 
units of an embodiment of the present invention. An 
interface 1 is provided for a user to input data and to 
receive output data including context data. This 
interface includes a device la for allowing the user to 
enter a query. The interface 1 also includes an output 
device lb for outputting the search data and the context 
data enabling a user to more readily understand the 
relationship between the query and the retrieved data and 
the relationships between the retrieved data. 

A parser 2 is provided for receiving the input query 
from the query input device la to generate semantic and 
syntactic information. The parser 2 also parses 
information from a database 3 which is to be searched. 
The parser 2 thus generates two sets of parsed data which 
is passed to a matching engine 4 to match the parsed 
data. The matching engine 4 in this embodiment performs 
matching using both semantic and syntactic information 
from the parser 2. The use of the semantic and syntactic 
information provides a more accurate matching technique. 

A context generating engine 5 receives data from the 
matching engine 4 and also receives linguistic 



relationship data from a storage device 6 . A context 
generating engine 5 generates context data for the 
matched data in accordance with the linguistic 
relationship data. A context gathering engine 7 receives 
the context data and uses this to generate a hierarchical 
index structure. This structure is used to organise the 
data retrieved from the database 3 so that it is ordered 
in accordance with the context data . The best match 
data, ordered in accordance with the context data, is 
then passed to the data output device lb for presentation 
to the user. 

Figure 2 illustrates schematically an embodiment of 
the present invention comprising a multi-purpose computer 
programmed to implement the present invention. The 
various components of the computer are illustrated linked 
by the computer bus 14. A display device 10 is provided 
for outputting the search results and the context data. 
A processor 11 is provided and this implements software 
to perform the function of the matching engine 11a, the 
context data generating and gathering engine lib and the 
parser 11c illustrates as functions in Figure 1. A read- 
only memory device (ROM) 12 is provided and comprises the 
Bios of the computer. A working memory comprising random 
access memory (RAM) 13, is provided for use by the 
processor during the implementation of the programs. A 
keyboard 17 is provided to allow the input of the query 
by the user. A storage device 15 such as a hard disk 
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drive is provided for storing computer programs and data. 
The computer programs comprise the operating system for 
the computer, the parser program code for causing the 
processor 11 to implement the parser 11c , the matching 
5 program code for causing the processor 11 to implement 
the matching engine 11a, and the context generating and 
gathering program code for causing the processor to 
implement the context data generating and gathering 
engine lib. The data stored in the storage device 15 

10 comprises the parser data required by the parser program 
for the implementation of the parser 11c, matching data 
for use by the matching program to implement the matching 
engine 11a, and linguistic relationship data for use by 
the context data generating and gathering program to 

15 implement the context data generating and gathering 
engine lib. 

The database 16 is also provided and comprises the 
database 3 of Figure 1. This database contains the sets 
of data to be found by the search. 

20 A communication interface 18 is provided for 

interfacing the computer to a network such as a local 
area network or the internet. Thus although in this 
embodiment the database 16 is shown as being within the 
computer, the database can be remote and accessible over 

25 the network- 
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The general operation of this embodiment of the 
present invention will now be described with reference 
to Figure 3 . 

In step SI the user inputs a natural language query, 
5 This input query is then parsed in step S2. In step S3 
a set of reference data in the database to be searched 
is selected and parsed. The parser in this embodiment 
comprises a finite state parser carrying out a dependency 
parsing operation. Finite state parsers in general are 
10 well known and the specifics of the implementation are 
not important for a description of the invention. The 
specific implementation is disclosed in co-pending 
application entitled: "Apparatus and Method for 
Generating Processor Usuable Data from Natural Language 
15 Input Data" filed on 1 March 1999 the content of which 
is hereby incorporated by reference. 

The parsed query and set of reference data then 
undergo matching in step S4 to identify the matched 
linguistic units. A linguistic unit can comprise any 
20 lexical unit such as a word or multi-words such as "the 
white house". The matching process carried out is in 
accordance with the process described in the applicants 
earlier application GB 9821969.4, the content of which 
is hereby incorporated by reference. 
25 In step S6 it is determined whether there are any 

words which match as a result of the matching step. If 
not, in step S7 because there are no matched words 



between the query in the set of reference data it is then 
determined if there are more sets of reference data to 
be matched. If so the process returns to step S3, 
otherwise the process terminates in step S8 with the 
output of any context data stored in the memory. 

The data generated as a result of the matching 
operation and using the finite state parser is data 
indicating a sequence of words, their parts of speech, 
a phrase bracketing structure, and the dependency 
relationships . 

In step S9 a first matched word t in the set of 
matched words T is selected. It is then determined in 
step S10 whether there are any unmatched words in the set 
of reference data. If not, the process proceeds to step 
S7 because there is no context information which can be 
generated for the set of reference data. Thus, the input 
query matched the set of reference data. If however, 
there are unmatched words indicating that the set of 
reference data contains additional information not 
requested in the query, in step Sll the first unmatched 
word u in the set of unmatched words U is selected. It 
is then determined whether the unmatched word u is at the 
end of a modification path from the matched word t. The 
paths are defined in path rules. The path rules define 
the lexical part of speech for the matched word, a valid 
path description from the matched word to the unmatched 
word and the phrasal category or lexical part of speech 



for the unmatched word. If it is determined that the 
matched word t and the unmatched word u are not linked 
in accordance with the path rules f it is determined in 
step SI 7 whether there are any unmatched words left 
unprocessed. If there are in step S13 the next unmatched 
word u is selected and the process returns to step S12. 
If not, in step SI 8 it is determined whether there are 
any matched words which are unprocessed. If not, the 
process returns to step S7 since the algorithm has 
processed all matched and unmatched words for the set of 
reference data. If there are still matched words to 
process in step S19 the next matched word t is selected 
and the process returns to step S10. 

If in step S12 it is determined that the unmatched 
word u is at the end of a path from a matched word t as 
defined in the path rules, in step S14 it is determined 
whether the unmatched word u is present in a valid phrase 
defined in the valid phrase rule. If there is no valid 
phrase, in step S13 the next unmatched word u is selected 
and the process returns to step S12. If a valid phrase 
is identified the smallest valid phrase containing the 
word u is determined in step S15 and in step S16 the 
phrase is added to the memory referenced to the matched 
word t. The memory thus stores the context data as 
unmatched words or phrases reference or linked to the 
respective matched words . 
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The valid phrase can comprise a part of speech for 
a word, or a phrasal category for a group of words. In 
step S17 it is then determined whether there are any 
unmatched words still left unprocessed and if so the 
5 process returns to step S13 to select the next unmatched 
word. If not in step SI 8 it is determined whether there 
are any matched words left unprocessed . If not the 
process returns to in step S7 since the unmatched and 
matched words have been processed for the set of 
10 reference data. If there are still matched words to be 
processed, in step S19 the next matched words t is 
selected and the process returns to step S10. 

Once a query has been input and parsed, the parsing, 
matching and context generation steps will be repeated 
15 for each set of reference data. 

The operation of steps S9 to SI 9 will now be 
described in more detail with reference to an example. 

The output of the matching process using the finite 
state parsing technique is a phrase represented as a 
20 sequence of words with their parts of speech, a phrase 
bracketing structure, and the dependency relationships. 
Hereinafter the part of speech (pos) is given by 
following each word with "_P0S" . The phrase bracketing 
for a phrase type PT is given as " [ . . . ]PT H . In addition 
25 words in the sets of reference data which match words in 
the query are marked in BOLD. 

For the query: 
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"camera with a lens 



tt 



and the reference data: 
"black SLR camera with a zoom lens on a white surface" 
the data output from the matching engine is: 



[[black_adj SLR_noun camera_noun ] NG , 
[with prep a_jdet zoom__noun lens_noun]PP, 
[on_prep a__det white_adj surf ace__noun]PP]NP 



1 0 mod [ camera ] =black 
mod [ camera ] =SLR 
pmod [ camera ] =with 
pmod [ camera ] =on 
mod [ with ] =lens 

15 mod [ lens ]=zoom 
mod [ on ] =sur f ace 
mod [ surface ] =white 



In the notation given hereinabove, the parts of 



5 



20 



speech are: 



adj - 



adjective 



noun - 



noun 



prep - 



preposition 



det 



determiner 



25 



The phrase types are: 
NG - noun group 
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PP - prepositional phrase 
NP - noun phrase 

The dependency relationships are given as indexed 
5 variables as generated by the finite state parser 
described in co-pending application entitled: "Apparatus 
and Method for Generating Processor Usuable Data from 
Natural Language Input Data" filed on 1 March 1999- Thus 
mod [ camera ]=b lack defines that the modifier of the word 
10 "camera" is the word "black". A prepositional modifier 
(pmod) of the word "camera" is the word "on". 

Figure 4 illustrates the modification relationships 
i.e. paths for the query and the reference data set. 

Hereinafter a path is referred to and comprises a 
15 modification relationship between two words. For 
example, a path from the word "camera" to the word 
"black" is given by a simple modification relationship 
i.e. mod . The path from the " camera " to the word 
"surface" is given by two consecutive paths pmod and mod 
20 via the word "on". 

The algorithm uses path rules as mentioned 
hereinabove. Each path rule has the form <r t ,r p ,r c >, 
where 

r t is a lexical part of speech for the matched word, 
25 r p is a path description as described hereinabove, 

and 
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r c is a phrasal category or a lexical part of speech 
for the unmatched word. 

Any one of these can be defined by a wildcard *. 
This means that the rule allows any value to be used e.g. 
any lexical part of speech, any path, or any phrasal 
category. 

The path descriptions take the form of a list of 
variable names e.g. mod or pmod:mod. 

In the algorithm three tests are performed each test 
results in a Boolean result. 

has pos(t f c) 

t is a matched word and c 
has pos(t,c) is true if either 
c or if c is a wildcard *. 

on path ( t , u , p ) 

t is a matched word, u is an unmatched word, and p 
is a path description. 

on__path( t ,u,p) is true if either p is a * or there 
is an unmatched path of type p from t to u i.e. the 
relationships in the path p are followed to get from t 
to u. This can be expressed recursively as follows. If 
p consists of a single element, then on__path( t ,u,p) is 
true if and only if u is a member of p[t]. If p is a list 
of variable names, of which the first is q and the rest 
of the list is r, then on_path( t,u,q:r) is true if and 



is a part of speech . 

t has the part of speech 



only if there is some word w which is a member of q[t] 
such that w is not marked as matched and on_path(w, u,r ) 
is true. The reason for saying "is a member of" here is 
that an indexed variable can have several words stored 
in it, as in example of pmod [ camera ]= {with, on} 
illustrated above. 

Valid-Phrase (C,p,u) 

p is a lexical part of speech or a phrasal category, 
u is an unmatched word. C is a phrase or word, valid 
phrase (C,p,u) is true if C has a category or part of 
speech p and u occurs in C. 

The Main Algorithm 

The main algorithm implemented by steps S7 to S17 
can be written in pseudo code as follows: 

Let S be the set of contexts f initially empty 
(output ) . 

Let P be the set of path rules (input). 

Let T be the set of current words, initialised to 
all matched words (input). 

Let U be the set of available words, initialised to 
all unmatched words (input). 



while T is not empty 
{ 

select a word t from T 



for each word u in U 
( 

if there is a path rule <r t ,r p ,r c > in P such 

that 

5 has_pos (t , r t ) 

AND onjpath(t,u,r p ) 
then 

find the smallest phrase C such that 
valid_jphrase (C,r c ,u) 
10 if. there is such a C then 

add the context <t,C> to S 
remove u from U 

} 

remove t from T 

15 } 

By "smallest phrase" what is meant is that if there 
is a valid phrase C and valid phrase D, and C is entirely- 
contained within D, then the C is used. 
20 The operation of the algorithm will now be 

illustrated with reference to the example described 
hereinabove and illustrated in Figure 4. 
The initial set T={ camera, lens} 

The initial set U= { black , SLR , zoom , white , surface , 
25 with,on,a} . 

The path rules to be used are: 

1. <*,mod,*> (this finds modifiers) 

2. <* ,pmod:mod,PP> (this finds prepositional phrases 
(PPs) ) 
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With the first matched word t="camera", and in the 
first unmatched word u= "black" the first rule applies 
because : 

has pos ( camera , * ) =TRUE 
5 on path ( camera , black , mod ) =TRUE 

We can find a suitable phrase (actually a single 
word) C=[black]adj so the context data 
<camera , [ black ] ad j> is added to the set S. 

With the second unmatched word u="SLR f ' rule 1 
10 applies for the same reason as given above and thus the 
context data <camera , [ SLR ]noun> is added to the context 
data set S. 

The only other word in the set U which complies with 
the path rules is the word "surface". When u="surface" 
15 rule 2 applies because: 

has pos ( camera , * ) =TRUE 

on path ( camera , surface , pmod : mod ) =TRUE 
A suitable phrase C=[on a white surface ]PP can be 
found, and so the context data <camera,[on a white 
20 surface ]PP> is added to the context data set S. 

All of the unmatched words for the matched word 
t=" camera" have thus been processed. 

The next matched word t=" lens" is then selected. The 
only word for which the path rules apply is the word 
25 u= M zoom". Rule 1 applies because: 
has, pos ( lens , * ) =TRUE 
on_ path (lens, zoom , mod ) =TRUE 
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A suitable phrase (actually a single word) is 
C=[ zoom] noun, so the context data <lens , [ zoom]noun> is 
added to the context data set S. 

The result of the algorithm is thus a set S of 
5 context data. Each entry in the set comprises a matched 
word and an unmatched word or phrase linguistically 
related to the matched word. This data can be output to 
a user to enable them to identify where the input query 
matches the set of data and the context of each of the 
10 matched words. 

When searching for data, it is most useful to use 
a query which results in a number of best matches being 
returned. It is thus desirable to use the context 
information to order the best matches in order to enable 
15 a user to see how the sets of reference data are related 
to one another and to the query. The context data 
generated as described hereinabove can be used to achieve 
this by gathering the contexts . 

The method of gathering the context data together 
20 to structure the search result will now be described. 

For each set of reference data the context data 
comprises a set of context in the form of a governor word 
and a context phrase. In the example given above the 
context data comprises: 
25 <camera, [black]adj> 

<camera , [ SLR ] noun> 

<camera,[on a white surface ]PP> 
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<lens , [ zoom]noun> 

As can be seen above, there can be more than one 
context phrase for a governor word. In the above 
example, "camera" has three context phrases. 
5 In order to provide structure to the output context 

data, additional information is used to context data. 
It is necessary to have knowledge of the head word in the 
query i.e. the word which does not modify any other word. 
Also, it is necessary to know the modification 

10 relationships between the matched (governor) words. For 
example, it can be seen in Figure 4 that the word 
"camera" is the head of the input query since it does not 
modify any other word. The matched word "lens" is the 
next matched word ( in this example it is in fact the only 

15 other matched word) in the modification chain from the 
head word. 

In addition to this information, a list of path 
levels is used in order to define the structuring of the 
output and to define the contexts which are of interest. 
20 The paths include an empty path which defines a matched 
(governor) word. Other paths such as mod and pmod define 
the modification path from the matched word to an 
unmatched word. The path can comprise a linked path such 
as pmod : mod . 

25 A method of forming the structure output will now 

be described with reference to Figure 5 and an example 
of data sets. 
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In step S20 of Figure 5 the context data for a 
plurality of data sets is input. For the query: 



ii 



camera with a lens" 



5 



The data sets which match are listed below together 
with their context data. In the context data {} means 
that there is no context data- Paths between the matched 
and unmatched words are also given in the context data 
10 below and are given in [ . . . ] . 



camera with a lens 



{} 
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Large camera with a lens 



<camera [ mod ] r large> 



camera with a lens on a table 



<camera [pmodrmod], [on a table]PP> 



20 



Large camera with a zoom lens 



<camera [mod] , large> 



<lens [mod] f zoom> 



25 



camera on a table with a long zoom lens 



<camera [pmodxmod], [on a table]PP> 



< lens [ mod ] , zoom> 



<lens [mod] / long> 



In step S21 of Figure 5 for each matched (governor) 
word the context data is concatenated so that there is 
a single context data for a particular matched word and 
a particular path. In the example given above, the 
concatenation of the last example results in: 

camera on a table with a long zoom lens 
<camera [pmod: mod] , [on a table ]PP> 
<lens [mod], long & zoom> 

In the process of this example the following path 
list is used: 
[] 

[ mod ] , [ pmod : mod ] 

[ ] indicates an empty path and is used to identify 
a matched ( governor ) word . This path is at the first 
level. The paths [mod] and [pmod: mod] are both at the 
second level . 

Using the path list and knowledge of the head of the 
input query, the head word is selected in step S22 of 
Figure 5. In step S23 is then determined whether there 
are any context words. If there are not, in step S24 the 
process then determines whether there are any further 
matched words which have not been processed. If not, in 
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step S30 the process terminates by storing any indexes 
and sub-indexes which have been determined. If there are 
further matched words to be processed, in step S25 the 
next matched word in the modification sequence is 
5 selected as a sub-index and the process returns to step 
S23. 

In the present example, in step S23 it is determined 
that there are context words. Thus in step S26 the 
context data for the second path level is selected i.e. 
10 any unmatched words linguistically related to the matched 
word camera by the paths mod and pmodrmod. In step S27 
the data sets are grouped according to common context 
words (or the lack of context words) and they are indexed 
by the common context word. The results of sorting the 
15 data search using the context data for the example given 
above is illustrated below: 
Camera 

large 

large camera with a lens 
20 large camera with a zoom lens 

[on a table ]PP 

camera with a lens on a table 

camera with a long zoom lens on a table 

() 

25 camera with a lens 
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In the above, the matched word (the head word) is 
shown in bold. () means empty context: "camera with a 
lens" exactly matched the query and there is no context 
data in relation to camera. 
5 In step S28 of Figure 5 it is then determined 

whether there are any more path levels. If there are more 
path levels in step S29 the next path level is selected 
and step S27 is repeated to generate further sub-indexed 
groups of data sets. In the present example in step S28 

10 it is determined that there are no more path levels and 
thus in step S25 the next matched word is selected as a 
sub-index. The next matched word in this example is the 
word "lens" and this is used as a sub-index for groups 
of more than one data sets. The process then returns to 

15 step S23 where in the present example it is determined 
whether there are context words to be processed and in 
step S26 the context for the second path level is 
selected. In step S27 the data sets are grouped according 
to the common context words and indexed accordingly. The 

20 result of this is illustrated below: 
Camera 

large 

lens 

zoom 

25 large camera with a zoom lens 

() 

large camera with a lens 
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[on a table ]PP 
lens 

long & zoom 

camera with a long zoom lens on 
a table 

() 

camera with a lens on a table 

() 

camera with a lens 

The result in step S30 is the storage of the 
hierarchial indexes and sub-indexes to which data sets 
belong. For example, the data set "large camera with a 
zoom lens" is indexed by camera : large: lens : zoom. A camera 
with a lens on a table is indexed by camera: [on a 
table ] PP : lens : ( ) . 

This ordering of the data using the context data 
enables the data to be output to a user in a format which 
enables the user to more easily understand the context 
of the match. 

A number of levels of context information depend 
upon the path levels used and the number of matched 
words. The number of contexts in each level will depend 
upon the context of the database being searched. For 
example, in the first level in the example given above 
there are, only two contexts: large and [on a table] PP. 
If there were further data sets e.g. red camera with a 
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lens on a table, small camera with a lens on a table etc, 
the number of contexts in the first level would be 
greater. 

A second embodiment to the present invention will 
5 now be described with reference to Figure 6 . 

Figure 6 is a functional diagram of a second 
embodiment which has similar components to the functional 
diagram of the first embodiment illustrated in Figure 1. 
The second embodiment differs from the first embodiment 

10 only in that the parser 2 of the first embodiment which 
receives the input query and the data sets from the 
database 3, is replaced with a parser 20 which parses the 
output of the matching engine 4. In this embodiment the 
matching engine will perform key word matching. The 

15 syntactic information required in order to generate the 
context data is obtained by the parsing operation of the 
parser 20 subsequent to the matching process. This 
embodiment benefits from a simpler matching process but 
suffers from lack of accuracy in the matching process 

20 because of the lack of syntactic information. 

Although the present invention there has been 
described hereinabove with reference to specific 
embodiments, the present invention is not limited to 
25 these specific embodiments and modifications are possible 
within the scope of the invention as defined in the 
appendant claims . 
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In particular, the present invention is not limited 
to any particular type of matching process. The matching 
process needs only to identify words in the query which 
match words in the sets of data in the database. 

In order to obtain the necessary syntactic 
information to enable the formation of context data, a 
level of parsing is required. Any form of parser which 
can provide some form of the syntactic information can 
be used in the implementation of the present invention. 
For example, the pure dependency parser can be used as 
disclosed in the paper entitled "Parsing English with 
a Link Grammar" by D Sleator and D Temper ley (Carnegie 
Mellon University School of Computer Science, Technical 
Report No. CMEU CS 91 196, October 1991). In this system 
there is no phrase bracketing provided but parts of the 
algorithm that extract phrases could instead extract a 
sequence of words defined by having certain dependency 
links with matched terms. Parsers are disclosed in 
GB-A-2269 9 23, EP-A-0737 9 28 , the paper by T Jarvinen and 
P Tapanainen, and the paper by P Tapanainen and 
T Jarvinen for example. Also, simpler parsing techniques 
could be used such as disclosed in the paper by S Flank. 

The present invention is applicable to any form of 
searching technique and can be used with a wide range of 
search engines such as a web search engine and a database 
search engine. The output of such a search engine 
incorporating the present invention provides far more 



information to the user and allows the user to see the 
context of the results of the search. 

Although the present invention has been described 
hereinabove as residing in a programmed multipurpose 
computer, the present invention can of course be 
implemented using specifically designed hardware such as 
a logic circuit. 



32 



CLAIMS ; 

1 . Search apparatus for searching for data in the form 
of units of a natural language, the apparatus comprising: 
5 interface means for receiving an input query in the 

form of units of the natural language and for outputting 
the results of the search in the form of output data; 

matching means for searching for and identifying any 
matches between the units of the input query and the 
10 units of the data; 

generating means for, where there are unmatched 
units in the query and/or the data, generating context 
data in the form of one or more unmatched units of the 
query and/or the data, each unmatched unit having a 
15 predefined linguistic relationship to one of the or each 
matched unit; and 

forming means for forming said output data as any 
said matched units and any respective said context data. 

20 2. Search apparatus according to claim 1, wherein said 
generating means is adapted to generate the or each 
unmatched unit of the context data having a predefined 
modification relationship to the respective matched 
units . 

25 

3. Search apparatus according to claim 1 or claim 2, 
wherein said generating means operates in accordance with 
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one or more rules defining contextual ly important 
modification relationships between matched and unmatched 
units . 

5 4. Search apparatus according to claim 1 or claim 2, 
wherein said generating means operates in accordance with 
one or more rules containing syntactic and semantic 
constraints for the formation of the context data. 

10 5. Search apparatus according to any preceding claim 
including parsing means for parsing the input query 
and/or the data or the output of the matching means to 
determine linguistic relationships between the units . 

15 6. Search apparatus according to any preceding claim 
wherein said forming means is adapted to form said output 
data as any said matched units associated with respective 
said unmatched units having said predefined linguistic 
relationship to respective matched units . 

20 

7 . Search apparatus according to any preceding claim 
wherein said forming means is adapted to form said output 
data as a layered hierarchical structure identifying sets 
of data by their context data . 

25 

8. Search apparatus according to claim 7 , wherein said 
forming means is adapted to form said output data as a 



hierarchical structure formed from a said matched word 
comprising a head word of the input query, said context 
data for said context data for said head word forming one 
or more sublayers, any further matched words forming 
further sublayers of said sublayers, the order of 
selection of said further matched words being dependent 
on their modification relationship within the input 
query, said context data for said further matched words 
forming yet further sublayers, said sets of data being 
identified by a final said sublayer in the hierarchical 
structure . 

9 . A computer implemented processing data method for 
processing data to enhance the results of a search for 
data in the form of units of a natural language, the 
method compr i s ing : 

receiving an input query in the form of units of the 
natural language and outputting the results of the 
searching the form of output data; 

searching for and identifying any matches between 
the units of the input query and units of the data; 

for any matched units in the query and/or the data, 
generating context data in the form of one or more 
unmatched units of the query and/or the data, each 
unmatched unit having a predefined linguistic 
relationship to one of the or each matched unit; and 
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forming said output data as any said matched units 
and any respective said context data. 

I. 0. A method according to claim 9, wherein the or each 
5 unmatched unit of the context data is generated having 

a predefined modification relationship to the respective 
matched units . 

II. A method according to claim 9 or claim 10, wherein 
10 the context data is generated in accordance with one or 

more rules defining contextually important modification 
relationships between matched and unmatched units. 

12. A method according to claim 9 or claim 10, wherein 
15 the context data is generated in accordance with one or 

more rules containing syntactic and semantic constraints 
for the formation of the context data . 

13. A method according to any one of claims 9 to 12 , 
20 including parsing the input query and/or the data or the 

output of the matching step to determine linguistic 
relationships between the units . 

14. A method according to any one of claims 9 to 13, 
25 wherein the output data is formed as any said matched 

units associated with respective said unmatched units 
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having said predefined linguistic relationships to 
respective matched units . 

15. A method according to any one of claims 9 to 14, 
5 wherein said output data is formed as a layered 

hierarchical structure identifying sets of data by their 
context data . 

16. A method according to claim 15 , wherein said output 
10 data is formed from a said matched word comprising a head 

word of the input query, said context data for said 
context data for said head word forming one or more 
sublayers, any further matched words forming further 
sublayers of said sublayers, the order of selection of 
15 said further matched words being dependent on their 
modification relationship within the input query, said 
context data for said further matched words forming yet 
further sublayers, said sets of data being identified by 
a final said sublayer in the hierarchical structure. 

20 

17. Data retrieval apparatus for retrieving desired 
information units of a natural language from a plurality 
of available information units, the apparatus comprising: 

input means for inputting a query in units of the 
25 natural language; 

matching means for searching for and identifying any 
matches between the units of the input query and the 
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units of the available information units to identify the 
best matches between the input query and the plurality 
of available information units; 

generating means for receiving the best matches and 
5 for where there are unmatched units in the input query 
and/or the information units, generating context data in 
the form of one or more unmatched units each having a 
predefined linguistic relationship to one of the or each 
matched unit; and 
10 output means for outputting desired information 

units as the best matches with respective context data. 

18. Data retrieval apparatus according to claim 17, 
wherein said output means is adapted to output the 

15 desired information units ordered by said context data. 

19. A computer implemented data retrieval method for 
retrieving desired information units containing units of 
a natural language for a plurality of available 

20 information units, the method comprising: 

inputting a query in units of the natural language; 
searching for and identifying any matches between 
the units of the input query and the units of the 
available information units to identify the best matches 
25 between the input query and the plurality of available 
information units ; 
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for the best matches where there are unmatched units 
in the query and/or the information units, generating 
context data in the form of one or more unmatched unit 
each having a predefined linguistic relationship to one 
of the or each matched unit; and 

outputting desired information units as the best 
matches with respective said context data, 

20. The method of claim 19 , wherein the desired 
information units are output ordered by said context 
data . 



21. A storage medium storing processor implementable 
instructions for controlling a processor to carry out the 
method of any one of claims 9 to 16, 19 or 20. 

22. A signal carrying processor implementable 
instructions for controlling a processor to carry out the 
method of any one of claims 9 to 16, 19 or 20. 
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ABSTRACT 

NATURAL LANGUAGE SEARCH METHOD AND APPARATUS 

A method and apparatus for performing a search for 
information containing natural language is disclosed 
which uses a natural language query. The query is input 
in the form of units of the natural language and this is 
matched with units in the natural language of the data* 
Where there are unmatched units in the query and /or the 
data, context data in the form of one or more unmatched 
units of the query and/or the data is generated. Each 
unmatched unit as a predefined linguistic relationship 
to one of the or each matched unit. Output data is 
formed as matched units with any respective context data. 



1/6 



LINGUISTIC 
RELATIONSHIP 
DATA STORAGE 
DEVICE 



CONTEXT 
GENERATING 
ENGINE 



CONTEXT 
GATHERING 
ENGINE 



^1 



INTERFACE 
/1a 



QUERY 
INPUT 
DEVICE 



1b 



DATA 
OUTPUT 
DEVICE 




3 



Fig 1 



3/6 



S19 

SELECT NEXT 
MATCHED 
WORDt 




NO 



4/6 




5/6 



S20 



INPUT CONTEXT 
DATA FOR PLURALITY 
OF DATA SETS 



S21 



CONCATENATE 
CONTEXTS 



S22 



SELECT HEAD WORD 
USING FIRST PATH 



S25 

SELECT NEXT 
MATCHED WORD AS 
SUB-INDEX 



T 

YES 



S23 




NO 



NO 



STORE HIERARCHY OF 

INDEXES AND SUB- 
INDEXES TO WHICH THE 
DATA SETS BELONG 




SELECT CONTEXT 
WORD FOR SECOND 
LEVEL 



S27 



GROUP DATA SETS 
ACCORDING TO COMMON 
CONTEXT WORDS (OR NO 
CONTEXT) INDEXED BY 
COMMON CONTEXT 
WORDS 




YES- 



S29 

SELECT 
NEXT PATH 
LEVEL 



Fig 5 



6/6 



^1 



LINGUISTIC 
RELATIONSHIP 
DATA STORAGE 
DEVICE 



CONTEXT 
GENERATING 
ENGINE 



CONTEXT 
GATHERING 
ENGINE 



PARSER 



-20 



INTERFACE 
/1a 



-1b 



QUERY 
INPUT 
DEVICE 



MATCHING 
ENGINE 



DATA 
OUTPUT 
DEVICE 



DATABASE 



Fig 6 



